Skip to content

Conversation

@mcculls
Copy link
Contributor

@mcculls mcculls commented Jun 18, 2024

Backport of #7211 for v1.35.2

@mcculls mcculls added tag: no release notes Changes to exclude from release notes comp: tooling Build & Tooling labels Jun 18, 2024
@mcculls mcculls added this to the 1.35.2 milestone Jun 18, 2024
@mcculls mcculls requested a review from a team as a code owner June 18, 2024 10:13
@mcculls mcculls requested review from PerfectSlayer and am312 June 18, 2024 10:13
@pr-commenter
Copy link

pr-commenter bot commented Jun 18, 2024

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mcculls/ci-gitlab-v1.35.2
git_commit_date 1718631246 1718705504
git_commit_sha 5cf2f32 656475e
release_version 1.36.0-SNAPSHOT~5cf2f32aa9 1.36.0-SNAPSHOT~656475ea6b
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1718708505 1718708505
ci_job_id 546315907 546315907
ci_pipeline_id 36990375 36990375
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 3 performance regressions! Performance is the same for 48 metrics, 12 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:startup:insecure-bank:tracing:Remote Config worse
[+37.350µs; +85.890µs] or [+5.474%; +12.588%]
743.955µs 682.335µs
scenario:startup:petclinic:profiling:Remote Config worse
[+22.741µs; +71.280µs] or [+3.090%; +9.687%]
782.856µs 735.846µs
scenario:startup:petclinic:tracing:Remote Config worse
[+44.758µs; +89.401µs] or [+6.521%; +13.026%]
753.411µs 686.331µs
Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.36.0-SNAPSHOT~656475ea6b, baseline=1.36.0-SNAPSHOT~5cf2f32aa9

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.061 s) : 0, 1061226
Total [baseline] (10.304 s) : 0, 10303622
Agent [candidate] (1.06 s) : 0, 1060452
Total [candidate] (10.373 s) : 0, 10373178
section appsec
Agent [baseline] (1.193 s) : 0, 1192967
Total [baseline] (10.45 s) : 0, 10449775
Agent [candidate] (1.181 s) : 0, 1180828
Total [candidate] (10.418 s) : 0, 10417811
section iast
Agent [baseline] (1.179 s) : 0, 1178841
Total [baseline] (10.705 s) : 0, 10705114
Agent [candidate] (1.179 s) : 0, 1179445
Total [candidate] (10.662 s) : 0, 10662468
section profiling
Agent [baseline] (1.26 s) : 0, 1260120
Total [baseline] (10.612 s) : 0, 10611848
Agent [candidate] (1.262 s) : 0, 1262340
Total [candidate] (10.611 s) : 0, 10610729
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.061 s -
Agent appsec 1.193 s 131.741 ms (12.4%)
Agent iast 1.179 s 117.615 ms (11.1%)
Agent profiling 1.26 s 198.895 ms (18.7%)
Total tracing 10.304 s -
Total appsec 10.45 s 146.153 ms (1.4%)
Total iast 10.705 s 401.493 ms (3.9%)
Total profiling 10.612 s 308.226 ms (3.0%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.06 s -
Agent appsec 1.181 s 120.376 ms (11.4%)
Agent iast 1.179 s 118.993 ms (11.2%)
Agent profiling 1.262 s 201.889 ms (19.0%)
Total tracing 10.373 s -
Total appsec 10.418 s 44.633 ms (0.4%)
Total iast 10.662 s 289.29 ms (2.8%)
Total profiling 10.611 s 237.551 ms (2.3%)
gantt
    title petclinic - break down per module: candidate=1.36.0-SNAPSHOT~656475ea6b, baseline=1.36.0-SNAPSHOT~5cf2f32aa9

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (665.009 ms) : 0, 665009
BytebuddyAgent [candidate] (664.251 ms) : 0, 664251
GlobalTracer [baseline] (303.33 ms) : 0, 303330
GlobalTracer [candidate] (303.376 ms) : 0, 303376
AppSec [baseline] (50.066 ms) : 0, 50066
AppSec [candidate] (50.255 ms) : 0, 50255
Remote Config [baseline] (686.331 µs) : 0, 686
Remote Config [candidate] (753.411 µs) : 0, 753
Telemetry [baseline] (7.668 ms) : 0, 7668
Telemetry [candidate] (7.492 ms) : 0, 7492
section appsec
BytebuddyAgent [baseline] (683.116 ms) : 0, 683116
BytebuddyAgent [candidate] (676.633 ms) : 0, 676633
GlobalTracer [baseline] (299.927 ms) : 0, 299927
GlobalTracer [candidate] (296.518 ms) : 0, 296518
AppSec [baseline] (154.689 ms) : 0, 154689
AppSec [candidate] (152.568 ms) : 0, 152568
Remote Config [baseline] (650.621 µs) : 0, 651
Remote Config [candidate] (677.21 µs) : 0, 677
Telemetry [baseline] (9.507 ms) : 0, 9507
Telemetry [candidate] (8.125 ms) : 0, 8125
IAST [baseline] (20.528 ms) : 0, 20528
IAST [candidate] (23.533 ms) : 0, 23533
section iast
BytebuddyAgent [baseline] (785.968 ms) : 0, 785968
BytebuddyAgent [candidate] (787.061 ms) : 0, 787061
GlobalTracer [baseline] (295.603 ms) : 0, 295603
GlobalTracer [candidate] (296.537 ms) : 0, 296537
AppSec [baseline] (47.478 ms) : 0, 47478
AppSec [candidate] (47.654 ms) : 0, 47654
Remote Config [baseline] (598.013 µs) : 0, 598
Remote Config [candidate] (598.114 µs) : 0, 598
Telemetry [baseline] (6.982 ms) : 0, 6982
Telemetry [candidate] (7.695 ms) : 0, 7695
IAST [baseline] (28.815 ms) : 0, 28815
IAST [candidate] (26.45 ms) : 0, 26450
section profiling
ProfilingAgent [baseline] (95.539 ms) : 0, 95539
ProfilingAgent [candidate] (96.224 ms) : 0, 96224
BytebuddyAgent [baseline] (663.007 ms) : 0, 663007
BytebuddyAgent [candidate] (663.581 ms) : 0, 663581
GlobalTracer [baseline] (385.304 ms) : 0, 385304
GlobalTracer [candidate] (386.084 ms) : 0, 386084
AppSec [baseline] (51.193 ms) : 0, 51193
AppSec [candidate] (51.235 ms) : 0, 51235
Remote Config [baseline] (735.846 µs) : 0, 736
Remote Config [candidate] (782.856 µs) : 0, 783
Telemetry [baseline] (7.345 ms) : 0, 7345
Telemetry [candidate] (7.344 ms) : 0, 7344
Profiling [baseline] (95.563 ms) : 0, 95563
Profiling [candidate] (96.249 ms) : 0, 96249
Loading
Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.36.0-SNAPSHOT~656475ea6b, baseline=1.36.0-SNAPSHOT~5cf2f32aa9

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.06 s) : 0, 1059772
Total [baseline] (8.535 s) : 0, 8535113
Agent [candidate] (1.068 s) : 0, 1068385
Total [candidate] (8.544 s) : 0, 8543692
section iast
Agent [baseline] (1.166 s) : 0, 1165860
Total [baseline] (8.981 s) : 0, 8980730
Agent [candidate] (1.177 s) : 0, 1177404
Total [candidate] (8.995 s) : 0, 8994646
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.169 s) : 0, 1168709
Total [baseline] (8.97 s) : 0, 8969539
Agent [candidate] (1.167 s) : 0, 1166895
Total [candidate] (8.972 s) : 0, 8972201
section iast_TELEMETRY_OFF
Agent [baseline] (1.166 s) : 0, 1166275
Total [baseline] (8.964 s) : 0, 8964408
Agent [candidate] (1.166 s) : 0, 1165926
Total [candidate] (9.003 s) : 0, 9003250
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.06 s -
Agent iast 1.166 s 106.088 ms (10.0%)
Agent iast_HARDCODED_SECRET_DISABLED 1.169 s 108.937 ms (10.3%)
Agent iast_TELEMETRY_OFF 1.166 s 106.503 ms (10.0%)
Total tracing 8.535 s -
Total iast 8.981 s 445.618 ms (5.2%)
Total iast_HARDCODED_SECRET_DISABLED 8.97 s 434.426 ms (5.1%)
Total iast_TELEMETRY_OFF 8.964 s 429.296 ms (5.0%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.068 s -
Agent iast 1.177 s 109.019 ms (10.2%)
Agent iast_HARDCODED_SECRET_DISABLED 1.167 s 98.51 ms (9.2%)
Agent iast_TELEMETRY_OFF 1.166 s 97.541 ms (9.1%)
Total tracing 8.544 s -
Total iast 8.995 s 450.953 ms (5.3%)
Total iast_HARDCODED_SECRET_DISABLED 8.972 s 428.509 ms (5.0%)
Total iast_TELEMETRY_OFF 9.003 s 459.558 ms (5.4%)
gantt
    title insecure-bank - break down per module: candidate=1.36.0-SNAPSHOT~656475ea6b, baseline=1.36.0-SNAPSHOT~5cf2f32aa9

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (664.628 ms) : 0, 664628
BytebuddyAgent [candidate] (669.502 ms) : 0, 669502
GlobalTracer [baseline] (302.64 ms) : 0, 302640
GlobalTracer [candidate] (305.721 ms) : 0, 305721
AppSec [baseline] (49.985 ms) : 0, 49985
AppSec [candidate] (50.254 ms) : 0, 50254
Remote Config [baseline] (682.335 µs) : 0, 682
Remote Config [candidate] (743.955 µs) : 0, 744
Telemetry [baseline] (7.542 ms) : 0, 7542
Telemetry [candidate] (7.529 ms) : 0, 7529
section iast
BytebuddyAgent [baseline] (778.196 ms) : 0, 778196
BytebuddyAgent [candidate] (784.911 ms) : 0, 784911
GlobalTracer [baseline] (292.897 ms) : 0, 292897
GlobalTracer [candidate] (295.485 ms) : 0, 295485
AppSec [baseline] (46.742 ms) : 0, 46742
AppSec [candidate] (47.374 ms) : 0, 47374
IAST [baseline] (27.162 ms) : 0, 27162
IAST [candidate] (28.041 ms) : 0, 28041
Remote Config [baseline] (637.708 µs) : 0, 638
Remote Config [candidate] (574.657 µs) : 0, 575
Telemetry [baseline] (6.963 ms) : 0, 6963
Telemetry [candidate] (7.639 ms) : 0, 7639
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (780.062 ms) : 0, 780062
BytebuddyAgent [candidate] (778.63 ms) : 0, 778630
GlobalTracer [baseline] (293.26 ms) : 0, 293260
GlobalTracer [candidate] (293.523 ms) : 0, 293523
AppSec [baseline] (47.148 ms) : 0, 47148
AppSec [candidate] (46.67 ms) : 0, 46670
IAST [baseline] (27.268 ms) : 0, 27268
IAST [candidate] (26.412 ms) : 0, 26412
Remote Config [baseline] (641.148 µs) : 0, 641
Remote Config [candidate] (589.827 µs) : 0, 590
Telemetry [baseline] (6.984 ms) : 0, 6984
Telemetry [candidate] (7.719 ms) : 0, 7719
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (776.943 ms) : 0, 776943
BytebuddyAgent [candidate] (775.977 ms) : 0, 775977
GlobalTracer [baseline] (293.215 ms) : 0, 293215
GlobalTracer [candidate] (294.752 ms) : 0, 294752
AppSec [baseline] (46.982 ms) : 0, 46982
AppSec [candidate] (48.306 ms) : 0, 48306
IAST [baseline] (28.474 ms) : 0, 28474
IAST [candidate] (26.162 ms) : 0, 26162
Remote Config [baseline] (583.793 µs) : 0, 584
Remote Config [candidate] (594.299 µs) : 0, 594
Telemetry [baseline] (6.779 ms) : 0, 6779
Telemetry [candidate] (6.843 ms) : 0, 6843
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-06-18T10:32:38 2024-06-18T10:39:27
git_branch master mcculls/ci-gitlab-v1.35.2
git_commit_date 1718631246 1718705504
git_commit_sha 5cf2f32 656475e
release_version 1.36.0-SNAPSHOT~5cf2f32aa9 1.36.0-SNAPSHOT~656475ea6b
start_time 2024-06-18T10:32:25 2024-06-18T10:39:14
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1718707513 1718707513
ci_job_id 546315908 546315908
ci_pipeline_id 36990375 36990375
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant iast iast

Summary

Found 0 performance improvements and 1 performance regressions! Performance is the same for 10 metrics, 17 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:petclinic:profiling worse
[+33.282µs; +87.361µs] or [+2.253%; +5.913%]
unstable
[-594.780op/s; +594.780op/s] or [-19.330%; +19.330%]
1.538ms 3076.923op/s 1.477ms 3076.923op/s
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.36.0-SNAPSHOT~656475ea6b, baseline=1.36.0-SNAPSHOT~5cf2f32aa9
    dateFormat X
    axisFormat %s
section baseline
no_agent (368.465 µs) : 349, 388
.   : milestone, 368,
iast (483.243 µs) : 462, 505
.   : milestone, 483,
iast_FULL (554.124 µs) : 533, 575
.   : milestone, 554,
iast_GLOBAL (503.457 µs) : 482, 525
.   : milestone, 503,
iast_HARDCODED_SECRET_DISABLED (479.229 µs) : 458, 500
.   : milestone, 479,
iast_INACTIVE (451.403 µs) : 430, 472
.   : milestone, 451,
iast_TELEMETRY_OFF (475.547 µs) : 454, 497
.   : milestone, 476,
tracing (444.458 µs) : 423, 466
.   : milestone, 444,
section candidate
no_agent (366.154 µs) : 346, 386
.   : milestone, 366,
iast (485.355 µs) : 464, 506
.   : milestone, 485,
iast_FULL (545.442 µs) : 524, 567
.   : milestone, 545,
iast_GLOBAL (511.635 µs) : 490, 533
.   : milestone, 512,
iast_HARDCODED_SECRET_DISABLED (481.091 µs) : 460, 502
.   : milestone, 481,
iast_INACTIVE (453.232 µs) : 432, 474
.   : milestone, 453,
iast_TELEMETRY_OFF (470.873 µs) : 449, 492
.   : milestone, 471,
tracing (445.928 µs) : 425, 467
.   : milestone, 446,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 368.465 µs [349.159 µs, 387.77 µs] -
iast 483.243 µs [461.764 µs, 504.722 µs] 114.778 µs (31.2%)
iast_FULL 554.124 µs [533.057 µs, 575.191 µs] 185.659 µs (50.4%)
iast_GLOBAL 503.457 µs [482.392 µs, 524.521 µs] 134.992 µs (36.6%)
iast_HARDCODED_SECRET_DISABLED 479.229 µs [458.384 µs, 500.075 µs] 110.765 µs (30.1%)
iast_INACTIVE 451.403 µs [430.493 µs, 472.312 µs] 82.938 µs (22.5%)
iast_TELEMETRY_OFF 475.547 µs [453.979 µs, 497.114 µs] 107.082 µs (29.1%)
tracing 444.458 µs [423.093 µs, 465.822 µs] 75.993 µs (20.6%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 366.154 µs [346.233 µs, 386.075 µs] -
iast 485.355 µs [464.212 µs, 506.499 µs] 119.202 µs (32.6%)
iast_FULL 545.442 µs [524.166 µs, 566.718 µs] 179.288 µs (49.0%)
iast_GLOBAL 511.635 µs [489.929 µs, 533.341 µs] 145.481 µs (39.7%)
iast_HARDCODED_SECRET_DISABLED 481.091 µs [459.83 µs, 502.351 µs] 114.937 µs (31.4%)
iast_INACTIVE 453.232 µs [432.042 µs, 474.422 µs] 87.078 µs (23.8%)
iast_TELEMETRY_OFF 470.873 µs [449.397 µs, 492.349 µs] 104.719 µs (28.6%)
tracing 445.928 µs [425.307 µs, 466.548 µs] 79.774 µs (21.8%)
Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.36.0-SNAPSHOT~656475ea6b, baseline=1.36.0-SNAPSHOT~5cf2f32aa9
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.354 ms) : 1334, 1375
.   : milestone, 1354,
appsec (1.724 ms) : 1699, 1748
.   : milestone, 1724,
appsec_no_iast (1.72 ms) : 1696, 1744
.   : milestone, 1720,
iast (1.485 ms) : 1462, 1508
.   : milestone, 1485,
profiling (1.477 ms) : 1453, 1502
.   : milestone, 1477,
tracing (1.473 ms) : 1449, 1497
.   : milestone, 1473,
section candidate
no_agent (1.356 ms) : 1337, 1376
.   : milestone, 1356,
appsec (1.72 ms) : 1696, 1745
.   : milestone, 1720,
appsec_no_iast (1.72 ms) : 1696, 1745
.   : milestone, 1720,
iast (1.466 ms) : 1442, 1491
.   : milestone, 1466,
profiling (1.538 ms) : 1512, 1563
.   : milestone, 1538,
tracing (1.478 ms) : 1454, 1502
.   : milestone, 1478,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.354 ms [1.334 ms, 1.375 ms] -
appsec 1.724 ms [1.699 ms, 1.748 ms] 369.242 µs (27.3%)
appsec_no_iast 1.72 ms [1.696 ms, 1.744 ms] 365.578 µs (27.0%)
iast 1.485 ms [1.462 ms, 1.508 ms] 130.286 µs (9.6%)
profiling 1.477 ms [1.453 ms, 1.502 ms] 123.07 µs (9.1%)
tracing 1.473 ms [1.449 ms, 1.497 ms] 118.539 µs (8.8%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.356 ms [1.337 ms, 1.376 ms] -
appsec 1.72 ms [1.696 ms, 1.745 ms] 364.135 µs (26.8%)
appsec_no_iast 1.72 ms [1.696 ms, 1.745 ms] 363.837 µs (26.8%)
iast 1.466 ms [1.442 ms, 1.491 ms] 110.128 µs (8.1%)
profiling 1.538 ms [1.512 ms, 1.563 ms] 181.371 µs (13.4%)
tracing 1.478 ms [1.454 ms, 1.502 ms] 121.613 µs (9.0%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mcculls/ci-gitlab-v1.35.2
git_commit_date 1718631246 1718705504
git_commit_sha 5cf2f32 656475e
release_version 1.36.0-SNAPSHOT~5cf2f32aa9 1.36.0-SNAPSHOT~656475ea6b
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1718708059 1718708059
ci_job_id 546315910 546315910
ci_pipeline_id 36990375 36990375
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.36.0-SNAPSHOT~656475ea6b, baseline=1.36.0-SNAPSHOT~5cf2f32aa9
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.464 ms) : 1453, 1475
.   : milestone, 1464,
appsec (2.228 ms) : 2193, 2263
.   : milestone, 2228,
iast (1.983 ms) : 1941, 2025
.   : milestone, 1983,
iast_GLOBAL (2.012 ms) : 1971, 2053
.   : milestone, 2012,
profiling (1.85 ms) : 1816, 1884
.   : milestone, 1850,
tracing (1.845 ms) : 1813, 1878
.   : milestone, 1845,
section candidate
no_agent (1.462 ms) : 1451, 1474
.   : milestone, 1462,
appsec (2.221 ms) : 2187, 2255
.   : milestone, 2221,
iast (1.976 ms) : 1936, 2017
.   : milestone, 1976,
iast_GLOBAL (2.012 ms) : 1971, 2054
.   : milestone, 2012,
profiling (1.862 ms) : 1828, 1896
.   : milestone, 1862,
tracing (1.832 ms) : 1800, 1864
.   : milestone, 1832,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.464 ms [1.453 ms, 1.475 ms] -
appsec 2.228 ms [2.193 ms, 2.263 ms] 763.733 µs (52.2%)
iast 1.983 ms [1.941 ms, 2.025 ms] 519.176 µs (35.5%)
iast_GLOBAL 2.012 ms [1.971 ms, 2.053 ms] 548.057 µs (37.4%)
profiling 1.85 ms [1.816 ms, 1.884 ms] 386.201 µs (26.4%)
tracing 1.845 ms [1.813 ms, 1.878 ms] 381.492 µs (26.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.462 ms [1.451 ms, 1.474 ms] -
appsec 2.221 ms [2.187 ms, 2.255 ms] 758.642 µs (51.9%)
iast 1.976 ms [1.936 ms, 2.017 ms] 514.189 µs (35.2%)
iast_GLOBAL 2.012 ms [1.971 ms, 2.054 ms] 550.064 µs (37.6%)
profiling 1.862 ms [1.828 ms, 1.896 ms] 399.754 µs (27.3%)
tracing 1.832 ms [1.8 ms, 1.864 ms] 369.265 µs (25.3%)
Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.36.0-SNAPSHOT~656475ea6b, baseline=1.36.0-SNAPSHOT~5cf2f32aa9
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.293 s) : 15293000, 15293000
.   : milestone, 15293000,
appsec (15.096 s) : 15096000, 15096000
.   : milestone, 15096000,
iast (18.816 s) : 18816000, 18816000
.   : milestone, 18816000,
iast_GLOBAL (18.159 s) : 18159000, 18159000
.   : milestone, 18159000,
profiling (15.259 s) : 15259000, 15259000
.   : milestone, 15259000,
tracing (15.147 s) : 15147000, 15147000
.   : milestone, 15147000,
section candidate
no_agent (15.582 s) : 15582000, 15582000
.   : milestone, 15582000,
appsec (15.015 s) : 15015000, 15015000
.   : milestone, 15015000,
iast (18.934 s) : 18934000, 18934000
.   : milestone, 18934000,
iast_GLOBAL (18.102 s) : 18102000, 18102000
.   : milestone, 18102000,
profiling (15.759 s) : 15759000, 15759000
.   : milestone, 15759000,
tracing (14.878 s) : 14878000, 14878000
.   : milestone, 14878000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.293 s [15.293 s, 15.293 s] -
appsec 15.096 s [15.096 s, 15.096 s] -197.0 ms (-1.3%)
iast 18.816 s [18.816 s, 18.816 s] 3.523 s (23.0%)
iast_GLOBAL 18.159 s [18.159 s, 18.159 s] 2.866 s (18.7%)
profiling 15.259 s [15.259 s, 15.259 s] -34.0 ms (-0.2%)
tracing 15.147 s [15.147 s, 15.147 s] -146.0 ms (-1.0%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.582 s [15.582 s, 15.582 s] -
appsec 15.015 s [15.015 s, 15.015 s] -567.0 ms (-3.6%)
iast 18.934 s [18.934 s, 18.934 s] 3.352 s (21.5%)
iast_GLOBAL 18.102 s [18.102 s, 18.102 s] 2.52 s (16.2%)
profiling 15.759 s [15.759 s, 15.759 s] 177.0 ms (1.1%)
tracing 14.878 s [14.878 s, 14.878 s] -704.0 ms (-4.5%)

@mcculls mcculls merged commit 816e6b1 into release/v1.35.x Jun 18, 2024
@mcculls mcculls deleted the mcculls/ci-gitlab-v1.35.2 branch June 18, 2024 11:07
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

comp: tooling Build & Tooling tag: no release notes Changes to exclude from release notes

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants